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Abstract 


We  demonstrate  that  there  are  natural  heuristics  for  partial 
enumeration,  that  are  not  based  on  tree  structure;  for  guiding  the 
enumeratlve  search,  nor  can  these  heuristics  be  implemented  in  any 
tree-search  framework.  We  also  provide  means  for  "redrawing  the  tree," 
when  the  current  state  of  a tree  search  makes  it  desirable  to  utilize 
a different  tree  representation  of  current  inform  tion. 
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TREELESS  SEARCHES 


by  C.E.  Blair  and  U.G.  Jeroslow 

I 

0 . Introduction 

The  most  successful  algorithms  to  date  for  the  practical  solution 
of  integer  programs  are  based  on  methods  of  partial  enumeration,  and 
often  derive  their  fathoming  power  from  linear  program;  and  cutting- 
planes  (see  e.g.,  [ 1 ] ).  Here  we  examine  some  basic  conceptions  of 
how  partial  enumerations  proceed,  and  identify  "hidden  assumptions" 
which  can  lead  to  overlooking  devices  that  are  likely  lo  limit  the 
size  of  the  enumeration. 

Specifically,  we  demonstrate  that  there  are  natural  heuristics 
for  partial  enumeration,  which  entail  enumerative  searches  that  are 
, not  based  on  tree  structures  for  guiding  the  next  state  of  the 

search.  In  addition,  we  provide  means  for  "redrawing  the  tree." 
Tree-redrawing  involves,  first,  the  consolidation  >r  "merging"  of 
alternative  problems  which  can  be  combined  into  on*  without  much  loss 
of  information;  and  second,  the  representation  of  the  set  of  merged 
subproblems  via  a tree  structure  which  does  not  require  very  many 
new  nodes  or  new  linear  programs  to  be  evaluated. 

f 

From  a practical  perspective,  the  techniques  of  this  paper  can  be 
useful  when  a search  has  "mushroomed,"  and  become  excessively  large 

I 

in  a certain  way,  specifically  the  same  relativel-  few  variables  are 
k branched  on  again  and  again  at  many  different  pans  of  i he  tree. 


/ 


IN 


2. 


This  kind  of  phenomenon  has  been  observed  in  practice,  usually  in 
connection  with  integer  programs  which  failed  to  run  successfully 
by  automatic  methods,  until  they  were  restarted  with  a different  set 
of  initial  branchings  specified  in  advance. 

1 . Treeless  searches 

In  a tree-guided  partial  enumeration  for  bivalent  integer  programs, 
at  any  given  point  of  time  the  current  state  of  the  search  can  be 
represented  by  the  set  of  bottommost  nodes  of  a tree  (the  "leaves"  of 
the  tree)  that  denote  partial  solutions,  both  unfathomed  and  fathomed. 
The  tree  structure  itself  describes  the  history  of  the  search. 

In  Figure  1 , let  denote  the  condition  - 1 and  A^  denote 
= 0;  also  temporarily  abbreviate  the  letters  A^.AjiA^  as  A,B,C. 

Then  Figure  1 constitutes  the  tree  structure  behind  the  search  in  which 
the  first  brant hing  variable  was  x^.  From  the  tree,  wi  see  that  x^ 
was  the  branching  variable  on  the  branch  x^  * 0;  thereafter  x^  was 
the  branching  variable  on  both  branches  x^  = 1 and  x ^ * 0.  Similarly, 
x^  was  the  branching  variable  on  the  branch  x^  = 1;  and  x ^ thereafter 
was  the  branching  variable  for  both  x^  * 1 and  x,}  * 0.  In  Figure  1, 
no  bottommost  partial  solution  has  been  fathomed. 

The  tree  of  Figure  1 tells  us  the  entire  hi  story  of  how  we 


obtained  the  eight  bottommost  nodes,  just  below  v/hich  we  have  written 
the  status  of  fixed  variables  in  an  obvious  symbolism.  However,  it  is 

really  the  leaves  themselves  which  aid  in  specifying  the  current  state 
of  the  search}  the  history  is  interesting  only  if  it  helps  us  to  resolve 
the  Integer  program. 


4. 


We  may  have  current  indications  that  at  the  node  denoted  ABC  I 

the  setting  x^  - 1 may  be  of  very  little  value  (fur  one  such 
indication,  see  Sec.  2.  below).  The  criterion  value  of  the 

associated  linear  program  at  ABC  may  be  very  little  changed  if 
the  implicit  constraint  *^  = 1 is  replaced  by  0 < < 1.  Possibly 

the  setting  Xj  = 0 is  also  of  little  value  at  ABC.  In  such  a case. 

Instead  of  proceeding  "forward"  and  choaing  another  branching  j 

1 

variable  at  ABC,  we  may  actually  want  to  move  "backward"  and  merge 
nodes  ABC  and  ABC  into  one  node. 

The  difficulty  with  merging  the  nodes  ABC  an<!  ABC  into  a new  node 
BC,  is  that  these  nodes  occur  at  very  different  parts  of  the  tree 
structure.  Had  the  historical  order  of  fixing  variables  first  been  B 
and  then  C,  followed  by  A and  A,  there  would  be  no  difficulty;  we 
would  simply  decide  that  was  not  the  proper  branching  variable  at 

node  BC,  and  we  would  chose  another.  However,  BC  is  not  the  historical  | 

order,  and  now  if  we  desire  to  keep  the  tree  structure  we  simply  can't 
do  the  merge  that  intuitively  we  ought  now  to  do.  Obviously,  the  tree 
structure  has  to  go. 

Indeed,  the  tree  structure  has  to  go,  but  no  simply  to  save 
one  linear  program,  by  combining  two  nodes  to  one.  The  nodes  ABC 
and  ABC  can  be  so  similar,  that  virtually  the  same  branching  variables 
will  be  chosen  in  refining  each  node,  so  that  whole  sections  of  the  { 

search  tree  will  become  unnecessarily  duplicated. 
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Kroin  Figure  1,  when  we  chose  Xj  as  the  first  branching  variable. 

It  was  bemuse  the  dichotomy  x^  I versus  x^  0 appeared  then  to  be 
very  significant,  probably  because  one  of  the  two  alternatives  was 
likely  to  be  easily  fathomed.  However,  given  BC  representing  the 
settings  ~ 1 an^  x-j  = evidently  the  effect  of  the  variable  x^  la 
now  inconsiderable.  This  would  be  the  case,  for  example.  If  the 
location  of  a warehouse  at  site  2(x 2 * 1)  or  site  3(x^  " 1)  Is  unlikely 

to  be  helpful,  given  the  overall  situation,  and  in  view  of  this  fact, 
the  location  of  a warehouse  at  site  1 (x^  = 1)  or  not  (x^  ■ 0)  Is 

clearly  a crucial  decision;  but  If  both  site  2 and  site  3 are 

(unexpectedly)  utilized,  then  a warehouse  at:  site  1 might  be  somewhat 
useful,  but  onl\  marginally  so. 

Originally,  the  state  of  our  current  search  can  be  represented  In 
terms  of  the  bottommost  nodes  of  the  tree  of  Figure  1,  In  this  way: 

(1)  ABC  V ABC  V ABC  V ABC  V ABC  V ABC  V ABC  V ABC 

Suppose  that  the  following  merges  are  found  to  be  advantageous  and  are 
performed: 

(2a)  ABC  and  ABC  to  BC 
(2b)  ABC  and  ABC  to  AB 
(2c)  AIM'  and  ABC  to  AO 

Then  the  slate  of  the  search  wl I I be  repre tinted  «y: 

(3)  BC  V AB  V ABC  V AC  V ABC 


which  has  only  five  subproblems  in  place  of  eight.  l)>  ,>n  reaching  (3), 
with  no  further  merges  possible,  the  search  can  be  resumed  only  by 
again  moving  "forward,"  i.e.,  by  choslng  some  one  subproblem  and 
branching  on  a new  variable. 

Is  there  a tree  structure  with  (3)  as  its  leaves?  To  put  the 
question  another  way,  if  we  had  in  advance  the  km w ledge  we  now  have, 

about  the  relative  affect  of  different  branchings  from  different 

nodes,  could  we  have  figured  out  the  "right"  variable  to  branch  on 
at  the  start  and  subsequently? 

The  answer  to  this  question  is  "no,"  since  a ly  one  branching 
variable  at  the  'op  of  the  tree  gives  some  letter  P such  that  either 
P or  P must  occur  in  all  leaves  of  the  tree,  but  no  si ch  letter  P 
exists  for  (3). 

Our  analysis  just  previous  of  course  does  not  demonstrate  that 
a good  enumerative  search  must  of  necessity  diver -e  from  a tree 
structure  during  at  ' least  some  parts  of  the  search;  possibly  most  such 
searches  do  have  tree  representations  for  their  h' stories.  We  have 
seen,  however,  that  guiding  a search  by  reference  to  a tree  structure 
requires  a special  effort  in  representing  past  events,  and  can  get 
in  the  way  of  natural  heuristics. 

It  is  certainly  true  that  treeless  searches  can  require  more 
"bookkeeping"  than  a LIFO  ("depth-first")  strate  ;y,  but  the  latter 
has  been  proven  decidedly  inferior  to  flexible  b icktracking  [5]  and 
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la  not  used  In  most  commercial  codes.  Fast  list-processing  subroutines 
that  save  whole  linear  programs  are  often  to  be  preferred  to  simplistic 
approaches. 


2.  Merging  and  "reverse  penalties." 

Merging  is  possible  when  two  nodes  have  descriptions 

(4)  A J ( 1 )A J (2)  '*•  AJ(r-l)AJ(r) 

and  Aja)Aj(2)  ...  Aj(r_i)Aj(r)  j 

that  are  Identical  except  for  exactly  one  "opposition,"  in  which  I 

AJ(f)  *8  °PP°9^te  Aj(r)‘  t*ie  ordcr  in  which  the  description  j 

Is  written  is  lmnaterial  (Aj(1)aj(2)  and  Aj(2)Aj(1)  arc  viewed  as  the 
same  logical  condition),  and  certainly  has  nothing  to  do  with  the 

t 

historical  order  of  fixing  variables).  If  a merging  is  performed. 

It  will  result  in  a node  described  as  A. ...A....  ...  A,.  ... 

J(l)  J (2)  J(r-l) 

Mergings  may  be  Iterated,  with,  e.g.,  ABC  and  ABC  merged  to  AB, 

ABC  and  Aic  merged  to  AB;  and  then  AB  and  AB  merged  to  A.  Also  A 
and  A can  be  merged  to  (8,  signifying  that  no  variable  hac  been  fixed 
at  any  value. 

When  would  the  merging  of  the  two  nodes  described  In  (A)  be 


advantageous? -this  Important  question  can  be  rephrased  in  a more 

useful  way  as  follows:  if  we  examined  a node  Aj ^ 1) AJ (2)  **’  AJ(r  1)’ 

when  would  we  decide  not  to  branch  on  variable  x^^,  provided  we 

had  any  reasonable  alternative?  Clearly,  we  would  not  branch  on 

x if  the  less  promising  of  the  two  resulting  subproblems  after 

J(r) 


a. 

branching  Is  not  "significantly"  less  promising  than  | )AJ(2)*  * * A|(t  1) 

t I sc  I I , with  "algnl  I li'.tnre"  possibly  iii.asmed  by  u " I III  vmIio  Id  ill  ll’tnelli  e" 

A O.-llere  A can  bo  iloto  mil  ued  by  a pi  lor  eypeclai  Ion  modified  with 

exponential  smoothing  by  criterion  value  changes  ac  tually  experienced. 

The  linear  program  associated  with  A... ...  A.. 

j(l)  J (2)  J(r-l) 

has  a value  for  each  different  right-hand-side,  and  as  this  right -hand- 

side  is  parametrically  varied  from  x..  * 0 to  x.,  . » 1,  this  value 

J (r)  J ( r) 

is  given  by  a function  f(w)  of  the  value  w of  x ^ * w.  From  theory, 
assuming  a minimizing  program,  we  know  that  f(w)  is  a piecewise  linear 
convex  function  of  w in  the  interval  0 < w <_  1,  and  clearly  the  linear 
programnlng  value  at  Aj (i)Aj (2) * ’ *AJ (r-1)  nu  n^mum  value  v of 

f(w)  on  the  interval  0 < w < 1,  since  the  constraint  0 < < 1 


occurs  among  those  of  the  linear  program.  The  rightward  slope  of 

f(w)  at  w * 0 is  easily  obtained  via  parametric  li  tear  programnlng,  or 

by  use  of  suitable  reduced  costs  (as  done  in  [2],  [3]);  and  similarly 

one  easily  computes  the  leftward  slop  of  f(w)  at  w *=  1. 

Clearly,  by  the  convexity  of  f,  if  0 then  v is  also  the  value 

of  the  problem  at  A . A . ...  A..  ..A,.  .,  and  the  optimum  at  this 

J(l)  j (2)  j (r-1)  j (r ) 

latter  node  (which  already  has  x ^ integral)  is  optimal  for 

Aj(l)Aj(2)  Aj(r-1)’  30  mer8^n8  i8  recousnended,  because  we  would  never 

have  branched  on  x . . given  the  situation  at  the  node  A,,,.A.,„  ...A  , 

l(r)  1(1)  ](2)  J fr-1 ) 

Again,  if  _ 0,  the  situation  favors  a merge. 

Now  assume  0 and  0,  let  v^  denote  ihe  value  of  the 

program  at  node  Aj(i)Aj(2)  •••  A j (r-i)AJ (r) ’ an<1  vp  ,,enote  the 


L 
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value  at  A..,  A ...  Aw  .A..  ..  From  convexity,  we  have  both 

j(l)  j (2)  j(r-l)  j (r) 

f(w)  > S^w  + v[}  and  f(w)  > S^w-l)  + v^.  It  follows  at  once 
that 


(5) 


v > min  |max{  SQw  + v^.S^fw-l)  + v^}  | 0 < w < lj 


SDVU  " Vd  ’ SDSU 
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Consequently,  merging  is  certainly  recommended  if  the  right-hand- 
side  of  (5)  plu;  A exceeds  maxfv^.v^}  (in  a minimizing  problem). 

The  right-hand-side  in  (5)  leads  to  a "reverse  penalty,"  and  was 
derived  by  virtually  reversing  the  analysis  that  provides  ordinary 
up-down  penalties  [1  ].  Just  as  penalties  provided  a lower  bound 
on  criterion  deterioration  after  branching,  reverse  penalties  provide 


an  upper  bound  >n  criterion  improvement  after  merging.  Reverse 
penalties  are  therefore  conservative,  and  merging  may  be  recommended 
even  when  the  previous  reverse  penalty  fails  to  signal  this  fact. 

As  with  penalties,  one  obtains  better  reverse  penalties  if  several 
pi vo 1 8 are  performed  in  parametric  programming. 

Clearly,  after  the  merging  of  the  two  nodes  described  in  (4), 

Xj(r)  should  not  be  used  as  a branching  variable,  unless  no  very 
promising  branching  variable  is  available.  This  simple  rule  is 
probably  sufficient  to  avoid  cycling  in  many  cases,  bur  cycling  can 
occur  when  e.g.,  0 is  branched  to  AVA  and  then  A and  A are  merged  to 
0.  To  insure  rigorously  against  cycling,  one  may  store  a representation 
of  every  node  which  resulted  from  a merge,  and  a list  of  variables  for 
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the  merges  resulting  In  this  node;  one  then  forbids  a merge  which 
repeats  a variable  In  the  list. 

In  examinin'*  the  current  state  of  the  search,  and  looking  for 
all  possible  merges  for  a specific  current  node,  the  whole  set  of 
current  nodes  must  be  scanned.  It  is  not  difficult  to  write  conditions 
for  detecting  possible  "partners”  for  the  given  node,  and  to  update 
these  dynamically;  however,  this  practice  results  in  a list  of  current 
notes  being  associated  with  each  current  node.  It  Is  probably  more 
efficient  to  simply  note  the  length  of  each  current  node,  to  compare 
nodes  of  a specific  length  against  the  one  or  two  nodes  Just  created, 
awl  see  If  they  have  precisely  one  opposition  on,.  then  applies  rev 
penalties  to  tha  : one  opposition  if  they  do. 


3.  The  systems  .ic  use  of  merging. 

To  understand  the  theoretical  limits  of  the  branch -merge -and - 
bound  methods  w.  have  outlined  above,  a certain  degree  of  abstraction 
is  necessary. 

We  shall  find  It  helpful  to  say  that  a logical  condition 


(6) 


BrV  B2V...V  Bt 


is  a (disjunct!  e)  normal  form  tautology,  oi  n.f.l.,  II  each 

II,  ( I _ k •_  l ) Is  the  conjunction  ol  atuinl<  Irtli  cm  A and  I l«c*  I r 
k ) 

negations  A (with  no  B,  containing  both  an  A and  A ),  and  If  («>) 

.1  **  J J 

Is  always  true  whether  each  A^  Is  true  or  false.  We  Bhall  call  (6) 
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a disjoint  tautology  if  each  pair  B^B^  exclude  e ich  other,  i.e., 
some  letter  A^  occurs  in  both  and  B^  but  in  opposition.  By 
definition,  0 is  a disjoint  tautology. 

Theorem:  The  repeated  use  of  branching  and  merging  produces  disjoint 
tautologies.  Moreover,  any  disjoint  tautology  cat  be  obtained  In 
this  manner. 

Proof:  Since  0 is  a disjoint  tautology,  to  prove  the  first  assertion 
we  need  only  establish  that  branching  and  merging  preserve  the  disjointness 
of  a disjoint  tautology  (6).  for  branching,  the  result  is  immediate. 

For  merging,  suppose  that  B.  and  B.  are  merged  into  P,  and  let  B be 

tl  K p 

other  than  B.  or  B.  . Then  the  truth  value  of  B A P Is  that  of 
h k p 

Bp  A (Bh  V Bk),  i.e.,  that  of  (Bp  A BR)  V (y^  A IJR  > , hence  Bp  A B is  always 

false.  Therefore  Bp  and  B most  have  at  lea  .t  one  Letter  in  opposition. 

For  the  second  assertion,  let  {a^,  A^» — ,Afc ] contain  all  the 

letters  occurring  in  any  B.  ( 1 < k < t ) . By  repeated  branching,  one 

+1  +1  +1 

obtains  a disjoint  tautology  of  which  the  general  term  is  A^  A2  ...A^  , 
using  the  abbreviation 

(a  tl  1 - ♦ 1 

<7>  > hi.., 


Each  such  term  is  consistent  with  exactly  one  BR  1 1 (6).  By  grouping 
together  that  set  of  terms  consistent  with  BR  and  cpcatcdly  merging, 
exactly  B^  Is  obtained. 


Q.K.D. 


12. 

3. 1 Non-dlsjolnt  normal  form  tautologies. 

A consideration  favoring  disjoint  tautologies  is  that  each 
subproblem  is  more  tightly  constrained  than  in  non  al  form  tautologies 
where  there  may  be  overlap  among  the  leaves.  This  consideration  could 
become  minor  if  certain  non-dis joint  n.f.t.'s  can  le  shown  to  provide 
more  "information"  than  any  disjoint  tautology  wit)  the  same  number 
of  leaves. 

How  much  "information"  a given  node  provides  in  terms  of  criterion 
value,  closeness  to  integrality,  etc.  - depends  of  course  on  the  exact 
integer  program  to  be  resolved.  In  general,  one  n< de  B^  can  be  guaranteed 
to  provide  as  much  information  as  another  only  f it  is  uniformly  more 

tightly  constrained,  i.e.,  if  contains  all  the  ixed  variables  of 

B^  fixed  at  their  values  for  (and  may  contain  mire  fixed  variables). 
When  this  latter  condition  occurs,  we  say  that  B^  s a refinement  of 
B^.  Also,  one  n.f.t.  is  a refinement  of  another,  f each  of  its  leaves 
is  a refinement  of  at  least  one  leaf  of  the  other. 

Here  is  a non-dis joint  n.f.t.,  which  possesse  the  property  that 
its  every  disjoint  refinement  has  more  leave;: 

(8)  AB  V CD  V AC  v AD  V bc  V go 

The  reader  can  eisily  check  that  (8)  is  a tautology  it  is  clearly  not 

disjoint. 

Suppose  that  the  following  disjoint  tautology  is  a refinement  of 

(8): 


(6)' 


BjV  ...VB|  . 


) 
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We  shall  say  that  B^  is  unique  to  a leaf  of  (8)if  it  refines  that  leaf 
and  only  that  leaf.  To  prove  that  t'  exceeds  six  (the  number  of  leaves 
of  (8)),  it  clearly  suffices  to  show:  (i)  Each  le.if  of  (8)  has  a leaf 
of  (6)'  that  is  unique  to  it;  (li)  At  least  one  p.tir  of  leaves  of  (8) 
have  at  least  three  distinct  B^  's  in  (6)'  that  ar  refinements  of  at 
least  one  node  of  the  pair  and  are  not  refinements  of  any  leaf  of  (8) 
not  in  the  pair. 

To  establish  (i),  note  that  there  are  sixteen  truth  valuations 
of  the  four  letters  A,B,C,D,  and  that  each  leaf  oi  (8)  has  a valuation 

that  makes  it  true  and  all  other  leaves  of  (8)  false.  This  valuation 

makes  at  least  one  leaf  B'  of  (6)'  true,  and  clearly  B'  must  be  unique 

k k 

to  the  given  leaf  of  (8). 

To  establish  (ii)  , note  that  any  refinement  of  AB  or  of  CD  cannot 

be  a refinement  of  the  other  leaves  AC,  AD,  BC,  or  BD.  There  cannot 

be  only  two  refinements  of  both  AH  and  CD  in  total  , for  then  these  two 

would  be  AB  and  CD  themselves,  and  hence  would  noi  be  disjoint.  Hence 

there  are  at  least  three  B.  's  which  are  refinernem  ? of  AB  or  CD. 

k 

This  completes  our  proof  that  t'  exceeds  six 

There  is  a result  analogous  to  the  previous  heorem  for  nondisjoint 
n.f.t.'s,  in  which  the  simple  merging  operation  i replaced  by  a "copy 
and  merge"  operation.  Specifically,  one  alLows  s>  veral  "copies"  of  a 
given  leaf  to  b(  made,  each  different  one  of  whit  is  merged  with 


another  leaf,  to  which  it  has  an  opposition  at  a ifferent  variable. 


1A. 

The  proof  of  the  previous  Theorem  is  then  applicable,  virtually  unch inged 

±1  +1  Fl 

except  for  the  fact  that  one  copy  of  ...  is  made  for  each  B^ 

in  (6)  with  which  it  is  consistent.  The  branch-copy-inerge-and-boun  I 
approach  can,  in  theory,  produce  any  n.f.t.,  d i ; joint  or  not. 

A . Redrawing  the  tree. 

The  concept  of  merging  can  also  be  used  to  .uggest  alternate  tree 
structures  for  a tree-based  search  already  under  /ay. 

We  illustrate  the  technique  by  an  example.  Suppose  the  tree  of 
Figure  1 has  the  advantageous  merges  (2a)  to  (2c;,  after  which  the 
state  of  the  search  would  be  given  by  '3).  (In  >eneral,  we  allow  th  • 
case  in  which  no  merges  are  advantageous,  or  in  vhich  one  chosen  to 
do  no  merges). 

To  represent  the  current  state  (3)  at  least  partially  in 
tree  form,  there  would  have  to  be  a "first"  branching  variable  with 
corresponding  letter  P,  such  that  P or  ? occurs  i i each  leaf.  As 
noted  in  Section  1,  no  such  letter  exists  for  (3).  But  if  e.g.,  we 
wished  to  branch  on  , we  can  artificially  have  )Oth  B and  B occur 
in  each  leaf,  by  viewing  AC  (which  is  the  only  le  if  not  containing  B) 
as  ABC  V ABC,  which  causes  an  increase  in  the  mm  >er  of  leaves.  (We 
will  see  in  Figure  2 that  this  "unmerging"  need  n t lead  us  back  to 
the  original  tree  of  Figure  1). 

The  general  situation  in  tree  re-drawing  is  : milar  to  that  of 
the  example.  The  search  to  the  present  point  of  time  is  unsatisfactory; 
one  has  picked  up  information  indicating  that  certain  variables, 
branched  on  lower  in  the  tree,  may  be  more  "significant"  that  the 
variables  branched  on  by  the  automatic  procedure  toward  the  top  of  the 
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tree.  One  wants  to  perform  merges  and  proceed  with  a treeless  search; 

one  first  performs  these  merges,  at  least  symbolically,  but  the 

necessity  of  using  a branching  code  forces  u;  to  tree  redrawing. 

After  one  has  selected  the  variable  Xj  that  one  wishes  to  make 

the  first  branching  variable,  every  leaf  B^>  in  which  neither 

or  A.  appears,  must  be  doubled  to  become  B,A  V B,  A ; then  this 
j K J K J 

technique  is  repeated  inductively  with  the  resulting  branches  for 
Aj  and  A^,  and  wnatever  variables  are  viewed  as  good  choices  for 

"second"  branching  variables.  In  principle  any  first  blanching 
variable  x^  can  be  chosen. 


Clearly,  th>  consideration  of  avoiding  very  many  "doublings" 
leads  to  chosing  a branching  variable  such  that  the  number  of 
leaves  in  which  < ither  A^  or  A.  appear  (i.e.,  the  number  of  leave; 
which  will  not  have  to  be  doubled)  is  large,  if  not  maximum.  This 


approach  to  limiting  the  choice  of  branching  variable  is  also  in 
accordance  with  the  observation,  that  one  really  does  not  have  good 
information  throughout  the  tree  about  a variable  branched  on  only  at 
a few  places.  In  our  specific  example,  all  three  of  the  letters 
A,B,C  or  their  negations  appear  in  all  but  one  leaf,  so  the  choice  of 
first  branching  variable  is  left  to  other  heuristic  quite  possibly 
involving  the  observed  criterion  value  d • terlorat ion  with  each 
branching  on  a given  variable. 

Suppose  that  x^  is  chosen  as  first  branching  viriable  in  (3). 
Then  we  view  AC  a two  duplicates  ABC  V ABC , and  consequently,  on  the 
branch  * 1 we  have  the  problem  BC  V ABC  V ABC  » I*  ( C V AC  V AC  ); 
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the  method  is  repeated  on  C V AC  V AC.  This  time,  C and  C occur 
in  each  Leaf,  so  x ( is  the  branching  variable.  For  x.^  0,  we  have 

only  C;  the  method  terminates.  For  x_  = 1,  we  must  consider 
AC  V AC  = C»(  A V A ),  and  we  repeat  with  A V A,  which  is  a simple 
branching  on  Xj. 

On  the  branch  = 0,  we  have  the  problem 
AB  V ABC  V ABC  = B • ( A V AC  V AC  ) , hence  the  method  applies  to 
A V AC  V AC  and  the  branching  variable  is  x^;  etc.  The  results  are 
shown  in  Figure  ?,  where  nodes  which  are  not  among  the  leaves  of 
(3)  are  branched  to  on  dotted  lines. 

In  Figure  ?,  we  have  six  nodes,  in  place  of  the  five  leaves 
of  (3)  or  the  eight  leaves  of  Figure  1.  Only  the  values  of  the 
two  "artilical"  nodes  ABC  and  ABC  cannot  be  obtained  by  merging 
alone,  and  woulc  necessitate  solving  a new  linear  program. -One  may 
tentatively  use  the  value  of  the  merged  problem  AC  for  fathoming 
at  both  these  n<des,  and  one  never  needs  to  actually  solve  either  of 
the  two  additional  linear  programs,  unless  a backtracking  heuristic 
selects  one  of  these  for  further  examination. 

For  related  tree  redrawing  techniques  in  more  restrictive 
circumstances , i <-e  [2],  I 3]  or  | 6 ] . 


5.  Re  f inements . 
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In  our  examples  and  discussion  above,  the  individual  atomic 


letters  resp.  A.,  which  were  conjoined  to  form  leave  , represented 

x.  = 1 resp.  x.  0.  For  more  generality,  the  atomic  letters  can 

represent  any  system  of  linear  inequalities  and  equalities,  such 

that  repeated  branching  exhausts  all  the  logical  | ossibi litles. 

For  instance,  in  bivalent  programming  ( ne  ma  add  atomic  letters 

('jk  representing,  xj  = xh  and  C-k  represei  ting  = 1 - xk>  This 

is  the  "cross-branching"  that  the  second  author  i ttroduced  in  [4  ]; 

it  is  useful  when,  for  instance,  there  are  prior  expectations  as  to 

when  two  projects  are  likely  to  be  done  together  if  at  all  fx^  = x^) , 

or  are  basically  opposed  projects  (x . = 1 - x,  ) . 

J k 

In  the  present  framework,  the  cross-branching  allows  a novel 

merging  in  addition  to  the  obvious  merges  like  B.C,,  and  B,C.,  to  B., 

i jk  i jk  i’ 

for  a leaf  B^ . Specifically,  we  have  the  "two  o|  positions  merge" 

of  B A. A and  B A. A to  B C,.  , as  well  as  1 .A. A.  and  B.A,AU  to  B ,C  . 
i J k i J h i jk  t j h l i h i jk 

Just  as  with  ordinary  branching,  the  cross- branching  reduces  dimension 


by  one . 

6 . Acki  owledg'  ments  . 

Th<  second  author  has  been  influenced  by  Find  Glover's 
emphasi  ; on  the  need  to  re-examine  the  basic  coi ceptions  behind 
enumera1 ive  algorithms  ( 2 ] . 

We  partit  ularly  wish  to  thank  Roger  I eddin  of  UNIVAC  for  an 
interesting  discussion  of  problems  arising  duri  ig  tree-searches 
lor  solving  Integer  programs  from  industr/,  in  /hich  lie  pointed 
out  th<  frequency  of  tree  structures  with  multi  >le  occurrences  of 
branching  on  i he  same  set  variables.  The  term  'tree  redrawing"  is  his 
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■ We  demonstrate  that  there  are  natural  heuristics  for  pari ial  enumeration, 

that  are  not  based  on  tree  structures  for  guiding  the  ennmerative  search,  nor  | 
can  these  heuristics  be  implemented  irj(  an^Jjree-search  liamework.  We  alstw  i 
provide  gleans  lor  redrawing  the  tree,'”  when  the  current  state  of  a tree 
• search  makes  it  desirable  to  utilize  a different  tree  representation  of 
i current  informat  ion. 
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